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Abstract 

Consider a critical Galton-Watson process Z = {Z n : n = 0, 1, . . .} 
of index 1 + a, a G (0,1]. Let Sf-(j) denote the sum of the Z n 
with n in the window [k, ...,fc + j), and M m (j) the maximum of 
the Sk{j) with k moving in [0, m — j]. We describe the asymptotic 
behavior of the expectation EM m (j) if the window width j — j m is 
such that j/m converges in [0, 1] as m f 00. This will be achieved 
via establishing the asymptotic behavior of the tail probabilities of 
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1 Introduction and statement of results 

Let Z = {Z n : n > 0} denote a Galton-Watson process. As a rule, we 
start with a single ancestor: Zq = 1. It will be convenient to write £ for 
the intrinsic number of offspring Z\ . We always assume that Z is critical^ 
that is E£ = 1. If not stated otherwise, we consider the case of branching 
of index 1 + a for some < a < 1. With this we mean that the related 
offspring generating function / satisfies 

f(s) := E/ = s + (l-s) 1+a L(l-s), 0<s<l, (1) 

where x i— > L(x) is a function slowly varying as x j 0. For k > and 

1 < j < m < oo, set 

k+j-i 

Sk(j) ■= V Z x and M m (j) := max S k {j). (2) 

* — ' 0<k<m—j 
l=k - - 

Extend these notations by monotone convergence to m = oo or even j = oo, 
and put 

M(j) := MM, l<J<oo. (3) 
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Since any critical Galton- Watson process dies a.s. in finite time, M(j) is a 
proper random variable for any j. In particular, M(oo) coincides with the 
total number So(oo) = Z + Z\ + ■ ■ ■ of individuals of Z. 

The main purpose of this note is to study the asymptotic behavior of 
the expectation EA/ m (j) when j might depend on m such that j/m — ► 
T] G [0, 1] as m | oo. 

To get a feeling, let us first discuss two special cases. If j = m, we have 

m — 1 

EM m (m) = ES Q (m) = E ^ Zi = m. (4) 

1=0 

On the other hand, the case j = 1 reduces to the investigation of the asymp- 
totic behavior of the expectation of M m (l) =: M m = maxo<fc< m _i Zk as 
m | oo. The last issue has a rather long history. First Weiner |Wei84 
demonstrated that if the critical process has a finite variance [which requires 
a = 1 in our case JTJ], then there exist constants < c < c < oo such 
that c < EM m /logm < c for all m. Then Kammerle and Schuh [RS86 
and Pakes |Pak87| have found explicit bounds for c from below and for c 
from above. Finally, Athreya |Ath88| established (still under the condition 
Var£ < oo) that 

EM m (l) = EM m ~ logm as m t oo. (5) 

In Borovkov and Vatutin jBV96| the validity of JSJ was proved under con- 
dition QJ. Moreover, in Vatutin and Topchii VT97 and Bondarenko and 
Topchii BT01] asymptotics © was established under much weaker condi- 
tions than JJJ, for instance, in |BT01| under E£log^(l + £) < oo for any 
> 0. 

Comparing the difference of orders at the right-hand sides of Q and 
J5J leads to the following natural question: What can be said about the 
behavior of EM m (j) when the width j of the moving window within which 
the total population size is calculated, may vary anyhow with m. For this 
purpose, we restrict our attention to processes satisfying J[J. Here is our 
main result. 

Theorem 1 (Expected maximal total progeny) Assume that j m > 1 
satisfies j m /m — > n G [0, 1] as m | oo. 

(a) If rj = 0, then 

(7TI \ 
— as m T oo. (6) 
3m' 

(b) If < 77 < 1, then 

EM m (j m ) - jmCfiiv) as m f oo, (7) 
where if is explicitly given in formula (|177|) below. In particular, 

<p(rj) ~ log - as -q I 0. (8) 
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Note that |JS} yields a continuous transition between the cases (a) and 

(b). 

We will deduce Theorem ^ y i a studying finer properties of M(j) = 
Moo(j)- In fact, we will establish the following asymptotic representation 
for tail probabilities of M(j). As usual, we write Q(n) for the survival 
probability P(Z n > 0). 

Theorem 2 (Tail of maximal total progeny) Assume that j n > 1 sat- 
isfies j n /(Q(Jn)n) -> y € [0, oo] as n] oo. 

(a) If y = oo, i/iera 

P(M(j„) > n) ~ P(M(oo) > n) ~ n"^^(n) as n t oo, (9) 
where £ is a function slowly varying at infinity. 

(b) If < y < oo, i/ien 

P(M(j„) > n) ~ Q(j„) ^(y) as n T oo, (10) 
where ip is explicitly given in formula (|139|l below. 

(c) Finally, if y — 0, f/ien 

P(M(j„) > n) ~ P(M(1) > nj;; 1 ) ~ ^ as n \ oo. (11) 

n 

The rest of the paper is organized as follows. In the next two subsec- 
tions, we state some (partially known) properties of critical Galton- Watson 
processes, preparing for the proof of parts (a) and (c) of Theorem |2 given 
in Subsection l3.ll This is followed in !2.3l bv a conditional invariance princi- 
ple for critical Galton- Watson processes of index 1 + a, see Proposition IkH 
needed for the proof of Theorem E{b) (also given in l3.1|) . Properties of the 
limit process X* arising in the mentioned invariance principle, are stud- 
ied in 12.41 and applied as Proposition El m the proof of Theorem ^b) in 
Subsection l3.3l 

2 Auxiliary tools 

2.1 Basic properties of critical processes of index 1 + a 

We start with some further notational conventions. If symbols L and I [as 
in and respectively] have an index, they also denote functions slowly 
varying at zero or infinity, respectively. In this case, the index might refer to 
the first place of its occurrence, for instance, for occurring in Lemma 
Furthermore, the letter c will always denote a (positive and finite) constant, 
which might change from place to place, except it has an index, which also 
might refer to the place of first occurrence. We will also use the following 
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convention: If a mathematical expression (as Z n ) is defined only for an 
integer (here n), but we write a non-negative number in it instead (as Z x ), 
then actually we mean the integer part of that number (here Z\S). 

Now we collect some basic properties of critical processes under our 
assumption (JJJ. The first lemma is taken from Vatutin [Vat 8 II Lemma 1]. 

Lemma 3 (Asymptotics of /') For f from Q we have 

1 - f'(s) ~ (1 + a )(l - s) a L(l -s) as s | 1. (12) 

(13) 
(14) 



The next lemma is due to Slack Sla 
Lemma 4 (Asymptotics of survival probability) As n \ oo, 

aQ a {n)L(Q{n)) ~ 1/n, 

implying 

-1/a 

for a function 



Q(n) ~ n'^ a ^n) 
(slowly varying at infinity). 



Set fo(s) := s, and / n (s) := /(/n-i(s)), H > 1, for the iterations of 
/. The following lemma can be considered as a local limit statement. 

Lemma 5 (A local limit statement) As n 1 oo, 



d n := I] /'(A(0)) 



-1—1/ a 



k=l 



Proof It follows from Lemmas and 01 that 

1-/(1-50=)) = ^ 

where S(k) ^0 as fc f oo. Hence, 



1 + <*(*)), 



(15) 



(16) 



exp[^log/'(/ fe (0)) 

k=l 



71 — 1 -. 

a x ^ 1 



~ n 



exp 



exp 



01 T ^r~ I Si(k) 



E 



k=l 



E 



A- 



as n I oo, 



(17) 



where 7 is Euler's constant, and also 6i(k) ^0 as fc f 00. According to 
Seneta |Sen76l Theorem 1.2 in Section 1.5], the function 



exp 



o ^-4 <5i(£:) 



E 

fc=i 



(18) 



is slowly varying at infinite. Combining this with (|17[l proves the lemma. □ 

The next statement might also be known from the literature. Recall 
that Af(oo) = Sb (00). 
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Lemma 6 (Maximal total population) As n t oo, 

P(M(oo) > n) = P(5 (oo) > n) ~ n^^^n). (19) 

Proof As well-known (see, for instance, Harris Har63, formula (1.13.3)]), 
h(s) :— Es So '°°' solves the equation 

h(s) = s f(h(s)), < s < 1. (20) 

By assumption we have 

h(s) = sh(s) + (l-h(s)) 1+a L(l-h(s)), (21) 
giving in view of h(l) = 1, 

(1 - h(s)f +a L(l - h(s)) ~ (1 - s) as s f 1. (22) 
Hence (cf. |Sen761 Section 1.5]), 

1 - h(s) ~ (1 - S )tt^ Lj53j(l - a) as s T 1, (23) 



and 



1 - Kb) g p( > n) s „ ^ as s t 1, (24) 



1-S n (1-S) 

implying (see, for instance, Feller |Fel711 Section XIII]), 

P(S (oo)>n) ~ —±— n -ThL^(l/n) =: n'^^n) ( 25 ) 

1 V 1+cJ 

as n f oo. This finishes the proof. □ 

Lemma 7 (Some tail asymptotics) The following statements hold, 
(a) As n | oo, if j„ > 1 satisfies j n / (Q(j n )n) — > oo, i/ien 



P(M(oo) > 

(7>; 4s j T oo, 



(26) 



P(M(oo) > j/Q(j)) ^ -^Tv «Ci)- (27) 

Proof (a) Recalling notation h introduced in the beginning of the proof 
of Lemma|H| set b x := 1 — h(l — 1/x), x € [l,oo). As a; f oo, it follows 
from HU) that 

6j +a L(i» x ) ~ 1/x, (28) 
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and from 1J23D that 

b x ~ i-rfeLgafl/a:). (29) 
By our assumption, j n — > oo, hence, by Lemma 0] 

Q 1+a 0'n)£(Q0'n))~ as n Too. (30) 

Thus, combined with 

Q 1+a 0«)£(Q0' n )) nQ(j„) 



V n +a L{b n ) a Jr 



as n I co. (31) 



Note that the function s i — *• (1 — s) 1+a L (1 — s) = /(s) — s is monotone (its 
derivative f'(s) — 1 is negative for s G [0, 1) by criticality). Applying this 
to 1 — s = Q{j n ) and 1 — s = b n , it follows from 1)3 ljl and properties of 
slowly varying functions that 

Q(jn)/b n ^0 as nj-iQUn) -f 0. (32) 

On the other hand, from (|25|l and l|29|) it follows that 

P(M(oo) >n) ~ - \ . b„ asnjco. (33) 

Combining this with (|32)l proves part (a) of the lemma, 
(b) Observe that by and 

P(M(oo) > j/Q(j)) ~ -^y 6 i/QW) as j T oo, (34) 

and that 

^^fe/Qti)) ~ ^J- as ^°°- (35) 
This, combined with l|3U|) and properties of slowly varying functions, implies 

b 3/QU) ~ 00') as J T oo- (36) 
Substituting (|36|) into (|34|l finishes the proof. □ 

2.2 Basic properties of critical processes 

For a while, we now discuss general critical Galton- Watson processes [i.e. 
we drop restriction QJ]. For R > 2, put 

B R := E{£(£ - 1); £ < i?} and i? := min{i? > 2 : B R > 0} < oo, (37) 

and set 

^•( s ) := izM = £ P(e>j)a i 0< S <1. (38) 
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Lemma 8 (Truncated variance) There exists a positive constant <^such 
that for any critical Galton- Watson process, 

Br < 2 ]T jP(£>j) < <$R{l-F(l-l/R)), R>2. (39) 

1<]<R 

Proof The first inequality in l|39(l essentially follows by integration by 
parts. For j satisfying 1 < j < R and x <E (0,1), we have the following 
elementary inequality: 

1 - (1 - x) j > jx (1 - x) 3 ' 1 > jx (1 - x) R , (40) 

which can be rewritten as 

j < - x)- R (l - (1 - x) j ). (41) 

Choosing x — 1/R and using criticality X^o-^^ > 0) = 1) we § e t from 
the first inequality in l|39() . 

o<i<fl: v 7 



1 \--R 



i>-R o<j<7? 

< cR(l-T{l - 1/R)), (42) 
as desired. □ 

The next statement is a particular case of Nagaev and Wachtel NW05 
Theorem 3]. 

Lemma 9 (A tail estimate) For m > 0, k > 1, yo > 0, and R > 2, 



■ 



P(M m+1 > fc) < + \ ■ 1 , ■ , • /■■ ? > > 

I/2/0 + (e 2 + e»° R )mB R /2' 

+ mP(£ > (43) 

If the variance of £, for the moment denoted by Boo . is finite and 
positive, then by Doob's inequality, 

P(M m+1 > fc) < m ^ 2 + 1 < (1 + l/Soo) ^ . (44) 

Estimate l|43|) allows us to derive an analogous bound without imposing the 
finiteness of Var£ : 
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Lemma 10 (A further tail estimate) There exist finite constants c j^j 
and ( fj7j| such that 

P(M m+1 > ft) < cq^ ^p- + mP(£ > k/2) (45) 

for all k,m>l satisfying k/{mB k ) > < \TUl - 

We see that, for k sufficiently large, the first term at the right hand side 
of (|45|l coincides with 144(1 concerning the truncated variance B k (except 
the choice of the constant). The second term compensates the truncation. 

Proof of Lemma 1101 In view of Lemma 00 B k /k — > as k f oo. Hence, 
there is a constant cggj > e such that for k, m > 1 with k/(mB k ) > cggj , 



Va ■= Vo{k,m) 



2 , k 3 , , k 

T lo S—5~ - T l °S^og—— 

k mB k k mB k 



(46) 



Hence, letting R = k/2 > 2 in 1(43(1 and observing that Br is non-decreasing 
in R, we get from Lemma El and our choice of R, 



P(M m+1 > ft) < (y + -) 



1 



1 



1/yo + (e 2 +e» t / 2 )mB t /2 
+ mP(£ > k/2). 



- 1 



From the estimates 



2 ft 2 k 
Vo < 7 log—- < -rlog-g— 

k mB k k B Ra 



(47) 



(48) 



being valid for all k > R , it follows that yo = yo(k, m) J, as k f oo, and, 
in addition, there exists a constant eggj such that for ft, m > 1 satisfying 
k/(mB k ) > cgTjj , 



fe 2 + e yok/2 " 



mB k /2 



< 2fclog" 3/2 (^ 



3/2 ( 

mB k 



mB k V mi?fe 

1 



mBfe/2 



< 



4y 



(49) 



Hence, for these ft, m, 



l/y + (e 2 + e y ° k ' 2 )mB k /2 < — . 

4y 



Clearly, for sufficiently small j/o > 0, 

1 

1 



1/2/0 + (e 2 +eV° k / 2 )mB k /2 



exp 



/,],,(! + ^ 



> exp 



> II 

4fty 



4yo 
5 



(-!) 



(50) 



(51) 
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By the definition of yo there exists cjg^J such that 

1-f > \ and y > ±\ log-^- (52) 
2 6 7 k mijfc 

for k/(mBk) > cj^J • Thus, we get the bound 

/ 1 \fe / k \8/7 

V 1 + 1/j/o + (e 2 + cvoW) m B k /2J ~ \~mB~ k ) ( ^ 

for k/(mB k ) > c|^j := max(c|^J, eggj, cj^j). Moreover, if k/(mB k ) > 
<jj@:=max(cj53J,2), then 

// 1 \ fc \ _1 {mB k \%/ 7 

l/y + (c2+c^/2) mjBfe / 2 J - 2 V~^J ' (54) 

Combining l|46(l - l|54|l gives, for k/(mBk) > 

k \\ fmBi- \ 8 / 7 
Jfc- 



(M m+1 > fe) < - 2 + log(— ) )(2Li) + m^>k/2). (55) 



The boundedness of the function x i— > x ^logx for x > 2 completes the 
proof of the lemma. □ 

Now we return to critical processes of index 1 + a. 

Lemma 11 (A moment estimate) Under condition for j3 € (1,1 + 
a), there is a constant ( TfJ\ = ( TfJ^ P) such that 

VZi < (QjQ^V). m > 1. (56) 
Proof According to assumption (JJJ, for < s < 1, 



1-F(s) f(s)-s j^ gl g _ L(l-s) 

;=o i=z+i 



1 r - Ys l Y P(g>z) = " l . (57) 

1 - s fl - s ) 2 ^ v ; (1 - s !- Q v ; 



Therefore, by Lemma [H] for all sufficiently large k, 

B k < ( g|K 1 - Q L(l/fc). (58) 

On the other hand, formula l|57|) and a Tauberian theorem (cf. |Fel711 The- 
orem 13.5.5]) imply 

k—l oo 1 

E P ^> 1 ) ~ fM ^"^(Vfc) as fctoo. (59) 
;=0 i=i+l 

Hence, for sufficiently large k, 

E P «> < ) ^ f^T^ Qi(1/fc) (60) 
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and 

2k oo 

fcP(£>2fc)< P(C>*) < z )' ( 61 ) 

i=k-\-l i—k 

leading to 

P(£>fc) < cfc~ Q - 1 J L(l/fc). (62) 
Combining 1(45(1 , 1)58(1 , and 1(62(1 , we see that there exist constants cjg^J an d 
C '|HSJ suc ^ ^ na ^' f° r m — 1 ana - au ^ > cg2j/Q(m), 

P(Z m > k) < P(M m+1 >k) < cWm*r 1-a .L(l/fc). (63) 

Clearly, for G (1, 1 + a), 

oo 

EZ£ < ^/3fc^ 1 P(Z m >fc). (64) 

fc=0 

In the range of the latter summation we distinguish between k < c ffift /Q(m) 
and k > c ffift /Q(m). Then, by criticality, the sum restricted to the first 
case is bounded from above by p c ^gj^Q 1 ~ l3 ( m ) = cQ l ~P(m) (with a con- 
stant c depending from /3). On the other hand, by 1(63(1 . the remaining 
restricted sum is bounded from above by 

H k^ a - 2 L{l/k) < cmQ 1+a ~ l3 (m)L(Q(m)) (65) 
fc > c |fi^]/9( m ) 

(cf. |Fel71l Theorem 8.9.1]), which by leads also to cQ 1_,3 (m), finishing 

the proof. □ 

Lemma 12 (Lower deviation probabilities) Fix 1 < j3 < 1+a. Under 
condition for e > there exists a constant = e) smc/i £/iai 

/or j ' > 1 and all y satisfying y > 2/e, 

I>{rai f Z l <y\z = (l + e)y} < m{^)V • ( 66 ) 



Moreover, for all j and y satisfying yj 1 > 2/e 



i-1 . : .0-1 



p{5><y|z = (i+ e )»- 1 } < nafc^ff) ~ • ( 6? ) 



Proof Fix j > 1 and y > 2/e. Clearly, 

P{ ; min Z ; < y Z = (1 + e)y} 

P{ min (Z, - Z ) < y - Z Z = (1 + e)y|. (68) 
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Obviously, y > 2/e implies that Z — y = [(1 + e)y\ — y > § y. Therefore 
168|) is bounded from above by 



P{ max \Zi-Z \ > \y Z = (l + e)y\. (69) 

I l<j — 1 Z ) 

Using this, Doob's inequality gives 

P{ min Zi<y Z = (1 + e)y) 
l i<j-i J 

2 p EUz^-Zof \Z = (l + e)y} 

* (i) P ~ (?0) 

(k) 

For the fixed j, let Zj_ 1} k > 1, denote independent copies of Zj-i given 
Zq = 1. Then, by the von Bahr-Esseen inequality vBE65 , 

E{\Z^ -Z f\Z = (l + e)y} = E | £ - l) f 

k=l 

< (l + e)yE{|Z 3 _ 1 -l| /3 \Z Q = l}. (71) 

Using now Lemma ITTI we see that 

E{|Z,_ 1 -1| /5 \Z Q = 1} < l + ^Q'^U) < (l + ^Q^U). (72) 

Combining JTD|) - ifT^. we obtain (|ffifl) . 

Noting that Xw=o < y implies mini^-i < yj~ l , and using veri- 
fied (|66|l . claim i|67[l follows, and the proof is finished. □ 

2.3 A conditional invariance principle 

From now on we always impose our basic assumption In this section, 
we establish convergence in law of the conditional scaled Galton- Watson 
processes 

{Q{n)Z nt : < t < t \ Z n > 0} as n T oo. 

We start with the description of the desired limiting process X* . First we 
consider a continuous-state branching process {X(t) : < t < oo} of index 
1 + a; more precisely, X is a [0, oo)-valued (time-homogeneous) Markov 
process with cadlag paths and transition Laplace functions 

E{e" AX W | X(0) = x} = exp[-x(t + X- a )-^ a ], X,t,x>0. (73) 

Introduce a random variable \ > having the Laplace transform 

F,e~ Xx = l-(l + \- a )- 1/a , A>0, (74) 
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(see, e.g., |Sla68| ). According to a general construction as in Durrett |Dur76j . 
we introduce a Markov process {X + (t) : < t < l} with cadlag paths and 
with the following properties: For y > and < t < 1, 

P(X+(t) 6 dy) = t~ l l a P{t l ' a X e dy ) P {x(l - 1) > | X(0) - y), (75) 

and, for x > and < s < £ < 1, 

P{A+(£) 6 dt/|X+(s) =a;} = (76) 
P{X(t - s) e dy; X(t - s) > | X(0) = x) 



P{X(t-s) >0\X(0) = x} 



■P{X(l-£) >0|X(0) = a:}. 



Finally, we define the Markov process {X*(t) : < £ < oo} as a concatena- 
tion of processes X + and X; more precisely, 

f X+(t) if < £ < 1, 

X * (t): = {^<0(.-i) , fi >i," (77) 

where I 1 refers to X starting from X(0) = x, and this family {X 1 : x > 0} 
is chosen independently of |A + (£) : < £ < l}. 

Proposition 13 (A conditional invariance principle) Let < to < 

oo. The following convergence in law on Z?[0,£o] holds: 

{Q(n)Z nt : < t < t I Z n > 0} ^ {**(«) : < £ < £ }. (78) 

1 rc,T°o 

Proof It suffices to show that for x > 0, 

{Q(n)Z„t : < £ < £ | Z Q = x/Q(n)} 
J=± \X(t): < £ < to \X(0) = x}, (79) 

nfoo 

in D[0, to], and that 

{Q(n)Z nt : 0<£<l|Z„>0} 

=^ |X+(£) : < t < 1 \X + (0) = 0}, (80) 

nfoo 

in Z?[0, 1]. In fact, from l|79|l and ^80(1. the Markov properties of the processes 
A + and X, as well as the definition of X* , the statement <|78ll follows. 



From the conditional limit theorem in Sla68 L it is easy to derive that 
for any £, x > 0, 

{Q(n)Z nt \Z Q = x/Q(n)} J± {X(t)\ X(0) = x}. (81) 

nf oo 

By Theorem 3.4 in Grimvall |(Tri74| . the validity of JEU implies tf7§J) . 
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To demonstrate (|8Uf) . we will use Theorem 3.9 from |Dur76j according 
to which it is necessary to show in our situation that, besides (|79|) . the 
following four statements hold: 

P( inf X(s) > X(0)=x\>0, t,x>0; (82) 

I 0<s<t J 



P{Z ntn >0\Z = x n /Q{n)} -> P{X(t) > | X(0) = x} (83) 
whenever t n — > t > and x„ — > x > 0; 

P{Z ntn >0\Z = x n /Q(n)} -h. (84) 
whenever t n — > t > and x n — > 0; finally, 

=^> as 1 1 0. (85) 

Since the state is absorbing for the branching process X, we have for 
t,x > 0, 

Pj inf X(s)>0 X(0) = x} = P{X(t) > | X(0) = x} 

= 1 - jkE{e _u(f) | X(0) = x) = 1 - exp[-xt~ 1/ot ], (86) 

proving Q82[l. As n | oo, if t„ — > t > and x„ — > x > 0, then, in view of 
114(1 and properties of slowly varying functions, 

Q(nt n ) + _ 1/q 



Q(n) 

and therefore, 



t~ i/a , (87) 



P{Z ni „ > | Z = x n /Q{n)} = 1 - (1 - Q{nt n j) 
-> 1 -cxp[-xf _1/Q ]. 



WQ00 



Combining (SB) and (JHHJl, we get (JH3 and gU- 

Finally, it follows from (|74|l that Ex' 3 < oo for any j3 € (1, 1 + a). Using 
this fact and (|75|l . we see that for such (3 and e > 0, 

P(X + (t) > e) < t- 1/a P(t 1/a x > e) < t {l3 - 1)/a e- p E X P -> (89) 

as t I 0. This justifies lj5oT) . Thus, l|5U|) is proved, and the proof of the 
lemma is complete. □ 
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2.4 On the limiting process X* 

For convenience, we introduce the notation 

rB+l 

V*(T) := sup / X*{u)du, T>1, (90) 

0<s<T-l Js 

and later we write V(T) in case of working with X instead of X* . In this 
subsection we establish the following result. 

Proposition 14 (Exact velocity) As T f oo, 

EV*(T) - logT. (91) 

The proof of this proposition will be prepared by the following three 
lemmas. 

Lemma 15 (Two estimates) For j3 € (1, 1 + a), 

pf sup X + (t)>x) < 1 A 3221, x>0. (92) 

V(Kt<l ^ x ' 

Moreover, for all T > and < y < x, 

Pf sup X(t) > x X(0) =y\ < m T^' a ^ . (93) 

Proof From the Donsker-Prokhorov invariance principle and (|80() it follows 
that for x > 0, 

Pf sup X + (t) >x) = \imP{Q(n)M n >x\Z n >0\. (94) 
\ <t<i ' "Too 

Using Doob's inequality and Lemma ITT1 we obtain 

P{Q(n)M n > x | Z n > 0} < Q- 1 (n)P(Q(n)M n > x) 

< Q ^ {n) ^f<m. (95) 

x p 

From here and l|94[l . estimate (|92l) follows. 

To prove l|93[) observe that by the Doob and von Bahr-Esseen inequalities 
and Lemma ll II 

vine \m > | 7 mi u < y Q» e Kt|^q = i} 
P{Q{n)M nT >x\Z = y/Q{n)} < ^— !— ^ i- 

S xP \Q(nT)J • iy ° j 
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On the other hand, by H79|) and the latter estimate, 
p( sup X(t) > x X{0) = y\ = lim P{Q(n)M nT > x I Z = y/Q{n)} 

0<t<T J ™T°o 

< m u m = mr<«« (97) 

- a;/ 3 nToo \ Q(nT)J x? y 1 

The first lemma is proved. □ 
Lemma 16 (Tail of maximum) For < y < x < oo, 

P( sup X(t) > x X(0) = y\ = 1 - fl - -T. (98) 

l -0<t<oo > v xJ 



Proof This follows from the Donsker-Prokhorov invariance principle, Lem- 
ma 1 in |BV96| . and Theorem 2 in |Pak78| . □ 

Lemma 17 (Minimal population) For e > there exists a constant 
< rp^ = < |7^ e), such that for all [3 G (1, 1 + a) and x > 0, 

P( inf X(t)<x X(0) = (1 + e) x) < 1A-E3-. (99) 
I o<t<i J ar -1 

Proof Applying we see that for e > 0, j > 1, and y > satisfying 
ey > 2 the inequality 



P{minz ; <,|z„ = (1 +e )y } < ^(^f ' (100) 

is true. Choosing now y — x/Q{j), we get for all sufficiently large j, 

P{ minZi < x/Q(j) \z = (l + e)x/Q(j)} < JgL . (101) 

Hence, applying the Donsker-Prokhorov principle, 179J1 . Ij83(l . and letting 
j 1 oo, the desired estimate follows. □ 

Having those three lemmas, the Proof of Provosition 1141 is now given by 
the following two lemmas. 

Lemma 18 (Upper expectation estimate) We have 

lim sup — !— EV*(T) < 1. (102) 
ttoo log I 

Proof Clearly, 

V*(T) < sup X*(s). (103) 

0<s<T 
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From definition J77J) of X* it follows that for x > 0, 



(106) 



P sup X*(s)>x) < P sup X+(s)>x 

+ / P(X+(l) e dy)p\ sup X(t)>x X(Q) = y\. (104) 

JO L 0<t<T > 

In view of 1^ . 

/ P( sup X + (s)>x)dx < oo. (105) 

Jl ^0<s<l ' 

Fix any < e < 1. By (|9*3|) and ijHSjl we get for x > 0, decomposing (0, a;), 
/ P(X+(l)Gd2/)p{ sup X(t)>a; X(0) = y\ 

JO 0<t<T J 

< jf* P(X+(1) e dy) minfEpT^- 1 )/^, 1 - (l - |)° 
+ P(X+(1) > ex). 
Noting that by the mean value theorem, for all y < ex, 

1 - (l - V -X < 2* f 1 - » ) a - 1 < a (1 - e) -i £ , (107) 
V a;/ a; V xJ x 

we have the bound 

rP(X+(l) G dy) min(ffilr(' 3 - 1 )/^, 1 - (l - |)°) 

< min f3ni r (/3-l)/« 7 n_ £ )a-l^\ ( 108 ) 

V a;* 3 a;/ 
since EX + (1) = E% = 1. Therefore, decomposing (l,oo), 

/ dx [ P(X + (1) G dy) P{ sup > a; X(0) = ?y| (109) 

Jl Jo 0<t<T J 

+ / dxP(X+(l) > ex) < (l-e)"" 1 logT + c+-, 
Ji £ 

where the last term follows by substitution and again by EJ + (1) = 1. This 
implies the claim. □ 

Lemma 19 (Lower expectation estimate) We have 

liminf — - — EV*(T) > 1. (110) 
ttoo logT y ' ~ y ' 
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Proof Recalling notation V introduced around (|90|l . it is not difficult to 
check that for T > 2 and x > 0, 

P(V*(T)>x)> [ P(X+(1) Gdy)P{V(T-l) >x\X(0) =y}. 

J(0,oo) 

Fix e € (0, 1) and put p := inf {u > : X(u) > (1 + e)x} [being equal to 
infinity if sup M> Q X(u) < (l + e)x]. Clearly, by the strong Markov property 
and properties of continuous-state branching processes, 



P{V(T-1) >x\X(0) = y} 



(111) 



/■T-2 

> / P{V(T-1)>X, pEdw\X(0) = y} 
Jo 

[ / X(u)du >x, pedw X(Q) = y\ 
( inf X{u)>x, pedw X(0)=yX. 

I w<u<w-]-l J 



T-2 



T-2 



> 



Using the strong Markov property at time p, the latter integral coincides 
with 



/ / P{pedw, X{w) edz X(0)=y) 

JO J{l+e)x L J 

x P{ inf X(u) > x X(0) = z) 

I 0<u<l J 

> P| m£ X(u)>x X(0) = (1 + e)x}p{p < T- 2 |X(0) = y). 

Applying Lemma ITTI we have, for all x > £o(e), 
P{U(r ~ 1) > x | X(0) = y} 

> (1-e)p{ sup X(t)>(l+e)x X(0) = y). (113) 

0<t<T-2 J 

On the other hand, 

P{ sup X(t)>(l + e)x X(0)=y\ (114) 

^ 0<t<T-2 > 

>p{ sup X(t)>(l + e)x X(0) = y\ - P{X(T - 2) > | X(0) = y). 



(112) 



0<t<OO 

Therefore we obtain 



P(V*(T) > a) 

>{!-£)( P(X+(1) e dy)p\ sup X(t)>(l + e)z X(0) = y} 

/>00 

- / P(X+(1) e d») P {X(T - 2) > | Z(0) = y}. (115) 
Jo 



18 



K. Flcischmann, V.A. Vatutin and V. Wachtcl 



From QJ, l(75|l. and iJSSJl, we see that 

/ P(X+(l)edy)P{X(T-2)>0\X(0) = y} 
Jo 

= 1-/ P(X+(1) e dy)exp -y(T-2)- 1 / Q = (T - l)" 1/a . (116) 
Jo L J 

It follows from that for fixed y > 0, 

P{ sup > a; X(0) = y\ ~ — as X | oo. (117) 



0<t<oo 

Hence, by Fatou's lemma, 



liminf x [ p( sup X(t)>(l + s)x X(0) = y\ P(X+(1) e dy) 

x 1°° J I 0<t<oo J 

> / lim xP{ sup X(t)>(l+e)a; X(0) = yj P(X + (1) e dy) 

/•oo 

= a(l + £) _1 / j/P(X+(l) € dy) = a(l+e) -1 . (118) 
Jo 

Substituting arrays (|116fl and i|118[l in (|115fl gives, for sufficiently large x, 

(119) 



P(V*(T)>x) > - (1 - 2e) - (T - 1) 

x 



-1/a 



Hence, for sufficiently large T, 

T i /Q 

/ P(V*(T) > x) dx > (l-2e)(l/a-e)alogT-(l-l/TY 
Jt? 

From here the statement of the lemma follows. 

3 Proof of the main results 

3.1 Proof of Theorem [2] 

(a) By monotonicity in j > 1, 

P(M(j) >n)< P(M(oo) > n). 

On the other hand, 



l/a 



□ 



(120) 



P(M(j) > n) > P(M(j) > n, Z,- = 0) = P(M(oo) > n, Zj = 0) 

> P(M(oo) > n) - P(Zj > 0). (121) 

Applying Lemmas and [Tfa) to l|120|) and (|121|l with j = j n justifies 
part (a) of the theorem. 
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(b) Recalling M(oo) = Sq(oo), since 

P(M(j n ) > n, Z jn = 0) = P(M(oo) > n, Z jn = 0) 

= P(5 (oo) > n) - P(5 (oo) > n, Z u > 0), (122) 

we have 

P(M(j„) > n) = P(M(j„) > n, %, > 0) + P(S M > n) 

- P(5 (oo) > n, Z jn > 0). (123) 

We investigate each term at the right hand side of array H123|l separately. 
First we deal with the second term. By JJJJ), Lemma[7{b), and our conditions, 



P(5 (oo) > n) ~ P(5o(oo) > -^—) ~ P 5 (oo) > 

v yQhr,)' \ Q(j n y 1+ °) 

i i 

QUnV'**) ~ K J' \ QUn) as n Too. (124) 



1 V 1+a i 1 V 1+aJ 

To study the asymptotic behavior of the last probability in array (|123f) . note 
that, for any fixed T > 1, 

P{5 (oo) > n | Z jn > 0} = P{5'o(oo) > n, Z Tjn = | Z jn > 0} (125) 

+ P{SoM > n, Z Tjn > | Z jn > 0}. 

The first probability term at the right hand side of decomposition (|125[) can 
be estimated from above as follows: 

P{S (Tj n ) > n, Z Tjn = \Z jn > 0} < P{S (Tj n ) > n \Z jn > 0}. (126) 

Concerning the other probability term in decomposition l|125fl . in view of 
l|14|) and properties of slowly varying functions there exists a constant c |j^y| 
such that for all n > 1 and j n > 1, 

P{S'o(oo) > n, Z Tjn > | Z jn > 0} < P{Z Tjn > | Z jn > 0} 

- Q ™ < m. (127) 



QUn) - TV 
Combining fT25|) - {TT7|) . 

< P{S'o(oo) > n | Z jn > 0} - P{S (Tj n ) > n \ Z jn > 0} 

< C C23 T_1/Q - ( 128 ) 

Using the Donsker-Prokhorov invariance principle and Proposition 1131 we 
see that 

lim P{S (Tj„) > n \ Z jn > 0} 



l-T-j 



nQ{jn) 



limpj / J " Q(j n )Z vjn dv > 

™T°o ^ J Q J n 

( rT 

p 



( j X*(v)dv>y- 1 ). (129) 
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Since T can be made arbitrary large, (|128f) and (|129fl imply 

limP{5 (oo) >n\Z jn > 0} = pf / X* (v)dv > y' 1 ) . (130) 

"Too \J J 

Thus, as n | oo, 

P(5 (oo) > n, Z jn > 0) - Q(i„)P( / X*(v)dv > jT 1 ). (131) 



Finally, to deal with the first probability term at the right-hand side of array 
Ijl23(l . observe that 

P{M(j n ) > n | Z jn > 0} = P{M(j n ) > n, Z Tjn = | Z jn > 0} (132) 

+ P{M(j n ) > n, Z Tjn > | Z jn > 0}. 

Here the first probability term can be written as 

V{M Tjn Un) > n, Z Tjn = | Z jn > 0} < P{M Tjn (j n ) > n | Z jn > 0}, 

whereas for the other term we have the upper bound 

P{Z Tjn > 0| Z 3n > 0}. (133) 

Both together and applying again Ijl27|l gives 

< P{M(j n ) > n | Z jn > 0} - P{M Tjn (jn) > n \ Z jn > 0} (134) 

< cr 1 '" 

Using the representation 
M T 3n (jn) = max Zi = j n max / z vj n dv (135) 

0<fc<(T-l)j„ f-^ 0<u<T-lJ u 

and applying the Donsker-Prokhorov invariance principle as well as Propo- 
sition IT3"I once again, we see that j~ Q(j n )Ti ~ * V implies 

lim P{M Tjn (jn) >n\Z jn > 0} 

n|oo 

= y T p{j- l Q{ ]n )M(j n )>^h Z]n > 0| = P(V*(T) > y- 1 ). (136) 

Hence, letting T — > oo and taking into account 1|134JI we obtain 

lim P{M(j n ) > n I Z jn > 0} = P(U*(oo) > y- 1 ). (137) 

n] oo 

Combining (|137|l . I|124f) . and l|131l) we see that Qij^nj^ 1 — > 2/ £ (0, oo) 
implies 

P(M(j»)>n) ~ i>(y)Q(jn), (138) 
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where 



4>(y) := P(V*(oo) >y- x ) 



(139) 



Note that ^ (y) > since the first term at the right-hand side of array 
<|123|) is of order Q(j n ) while the difference of the second and third terms is 
non-negative. 

(c) To establish <|11[) observe that M{j) < jM(l) and therefore by Theo- 
rem 1 from |BV96) . for any e > there exists K = K(e) such that for n 
and j satisfying nj > K, 



P(M(i) > n) < P(M(1) > nj' 1 ) < 



a(l + e)j 



(140) 



To get a similar estimate from below note that for e G (0, 1), 

P(M(j) > n) > P(M(j) > 7i, M(l) > (1 + e)^' -1 ) (141) 

OO 

= £p(M(i)>n, e = 0, 

where p := mm{/ : Z\ > (1 + e)nj -1 } is the first moment when the gener- 
ation size exceeds (1 + e)7y . By the Markov property we get 

P(M(j) > n, = l) = P ( M (J) > n, Zi = r, g = l) 

r>(l-\-e)nj~ 1 

i+j-i 

r>(l+e)nj~ 1 i=l 

= E p{X>*» 

r>(l+e)nj" 1 i=0 

> P(e = OP{E Z ^ n | Z o = ( 1 + £ ) n ^ 1 } 

i=0 



Z = r} P(Z, = r, q = 



(142) 



Therefore, 

P(M(j)>n) > 

P(M(1) > (1 + ejry- 1 ) P{ ^ > n | Z = (1 + ejry- 1 }. 



Choose /3 G (1, 1 + a) and using (|67|l . we obtain for nj 1 > 2/e, 
P(M(j) >») > P(M(1) > (l+sW-^l-Haf^"' 



(143) 



(144) 
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Observing that nj n 1 — > oo by our assumption in (c) and recalling that 
P(M(1) > x) ~ a/x as i | oo, estimates (|140|) and (1144(1 together imply 

P(M( 3n ) > n) ~ P(M(1) > nj- 1 ) ~ ^ as — ^— -» 0. (145) 

Theorem |21 is proved. □ 

3.2 Proof of Theorem UK a) 

Since M m (j) < M(j) for all j,m > 1, it follows from lfT2TJ|) that 

P(M m (i) > n) < P(M(j) > n) < P(M(oo) > n). (146) 

From here, l|19(l . and properties of regularly varying functions we conclude 
that, for any e £ (0, 1) and sufficiently large j, 

£ P(M m (j)>n) < X! P(M(oo)>n) 

^"^nroy i<n< e^(I7 

< 2 ^ l + Cl ' — l— p(m(oo) > - jr-rV (147) 

By LemmaEfb), we have for e £ (0, 1) and for sufficiently large j, 

P ( MM - ^y) - p ( M(oo) - ofe) - cQij) - (148) 

Hence, 

E P(^m(i)>n) <~3- (149) 

Moreover, for any /3 6 (1, 1 + a), 

P(M„(l)> I )< E ^lf = '} <£g^M, (1M> 
which, in view of P(M m (j) > n) < P(M TO (1) > implies 

]T P(M m (j)>n) < E P(M m (l)>nr 1 ) 



< cfQ^im) J2 n ~ & ^ c£l ~ P i ( 151 ) 

for j > jo ■ Clearly, 
P(M(j) > n) - P(Z m > 0) < P(M m (j) > n) < P(M(j) > n). (152) 
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This and (|145fl show that for any 6 <G (0, 1) there exists an e € (0, 1) such 
that 



(l_ 5) ^_P(Z m >0) < P(M m (j)>n) < (1 + 5) — 
n n 

for all n > £~ 1 j/Q(j)- Denoting 

D £ (j,m) := {n: e^j/QfJ) <n< ej/Q(m)} , 
we conclude that 

(l-S)aj Yl l / n ~ e 3 < E V(M m (j)>n) 

< {1 + S)aj J2 l l n ' 

n€LD E (j,m) 



(153) 
(154) 



(155) 



that is, 



(1 — S) aj log 



QUI 

Q{m) 



< P { M mU)>n) 



< (1 + 6) aj log + cj. 

Q(m) 



(156) 



Since the function ^ from lTH|) is slowly varying, there exists an a > and 
functions a and satisfying a(x) — s- a S (0, oo) and 8(x) — > as x f oo, 
such that (see |Sen76l Section 1.5]) 



trip) = cr(n)exp 



n 9{x) 



d.r 



(157) 



Hence, it follows easily that for any fj, > 0, there exists w — w(fi) such that 



< 



Mil 

^gm) 



< y— J a s j/m < w. 



(158) 



Therefore, for j/m < w, 



(l-*)(l- M )jlog_ < ^ P(M m (j)>n) 

neD £ (j,m) 

vn 

< (l + 5)(l + n) j log-. 

J 



(159) 



Combining (1 149(1 - 1159(1 and taking into account that 5 and /Lt can be made 
arbitrarily small, we get 



EM m (j) - j log — as j/m -> 0, 
J 



completing the proof of Theorem ^a). 



(160) 

□ 
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3.3 Proof of Theorem [T](b) 

Clearly, 

EM Tj (j) = E{M Tj (j); Z j = 0} + E{M Tj (j); Z j > 0} 

= E{5 (i); ^ = 0} + E{M Ti (j)i ^ > 0} (161) 

since 

fe+i-i 

M Ti (j)l {z . =0} = max J] Z,l {Zi=0} (162) 

i=fe 

i-i j-l 

- - 3 3 l =k l- 
We study each term in (|161|l separately, namely in Lemmasl20landl2*2*lbelow. 
Lemma 20 (Restricted expectation asymptotics) ^4s j f oo, 

aj : = E{SoC?);^ = 0}~ (163) 

Remark 21 (Finite variance case) Under Var£ < oo, this result was 
obtained by Karpenko and Nagaev in 

KN93]. O 

Proof Set 

/V(si,s 2 ) := E{ s f J 4 o(j) | Z = l}, ho(«i,«a) := «i« 2 . (164) 
Clearly, 

h 3 {s u s 2 ) = E|E{sf sf o(s) | Zi} Z = lj (165) 

= E| S2 (E{ s f J - 1 4 o( ^ 1) |Z -l}) Zl Z = l} = s 2 /(/ii-i(si,s 2 )). 
Hence, 

e{4 o0) , ^ = | Z = l} = h 3 -(0,a 2 ) = 82/(^1(0,82)). (166) 

Note, that %(0, 1) = /,(0) = P{Z,- = | Z = l} and 01 = /i(0). Differ- 
entiating l|lt)6|) at s 2 = 1— gives, for j > 2, 

Oj = /i(0)+/'(/i-i(0)) a i-i (167) 
= /i(0) + / / (/ J _i(0))/ i _ 1 (0)+/ / (/ i _ 1 (0))/'(/ i _ 2 (0))o i _2 

leading to 

j— 1 j— 1 j— 1 

«i = /i(0) + E /*(°) II /'(AW) - /i(0) + <*J 2 /*(°) J- > ( 168 ) 
A;— 1 r=fc fc=l 
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where the dk are as in Lemma |S] Recalling Lemma |S] and observing that 
/fc(0) t 1 as k | oo, we get 

E/*(°)X - Ew - aS ^oo. (169) 



fc=i 



k ^ ; 3 (fc) 2a + 1 l 3 (j) 



From here, 1(168(1 . and (|15|l . the statement of the lemma follows easily. □ 
Lemma 22 (Conditional expectation limit) For T > 1, 

lim E{j- 1 Q( j) M Tj (j) I ^ > 0} = ~EV*(T). (170) 

Proof It follows from Proposition ll3l and the Donsker-Prokhorov invariance 
principle that 

{j Mr A.r | Z 3 > 0} =4 V*(T). (171) 

To prove that convergence of the expectations takes place recall that 

M Tj (j) < M T] (Tj) = Z l- ( 172 ) 

Hence, 

Pir'Qi J) M Tj (j) > y | Z s > 0} < P{j- 1 Q( j) M Tj (Tj) > y | > 0} 

< P{ 0(i ) Q max Tj Z fe > „ | Zj > 0} < ^ -*L , (173) 

the last step by Doob's inequality. By Lemma ITT1 and 114|l . we can continue 
with 

c Q^Hj) _^ T (p-i)/ a (1U) 

- yP QP-i(Tj) ~ y? 1 ' U ^ 

Therefore, 

P(V*(T)>y) < ^-T^-V' a . (175) 

In order to complete the proof, note that since (3 > 1, derived chain of esti- 
mates (|173fl - (|174fl and inequality (|175|l provide the uniform integrability of 
the prelimiting and limiting variables in 1)171(1 . Hence, claimed convergence 
1(170(1 of moments follows. □ 

Now we are ready to complete the Proof of Theorem Clearly, 

j-^Mntim) (176) 

= j" 1 E{Af m (j m ), Z jm - 0} + j- 1 E{M m ( Jm ), Z jm > 0} 

= j' 1 E{S (j m ), Z jm = 0} + E{ Jm 1 Q( j m ) Mmtim) | Z jm > 0}. 
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Applying Lemmas I2UI and 1221 with T = I/77, we obtain 

lim j" 1 EM m (j m ) = -^—+EV*(1/ V ) =: v { v ), (177) 

mjoo + 1 

that is Q. Recalling Proposition O we see that © is valid as well. □ 
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